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Instrument and data analysis challenges 
for imaging spectropolarimetry 
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The next generation of solar telescopes will enable us to resolve the fundamental scales of the solar atmosphere, i.e., the 
pressure scale height and the photon mean free path. High-resolution observations of small-scale structures with sizes 
down to 50 km require complex post-focus instruments, which employ adaptive optics (AO) and benefit from advanced 
image restoration techniques. The GREGOR Fabry-Perot Interferometer (GFPI) will serve as an example of such an 
instrument to illustrate the challenges that are to be expected in instrumentation and data analysis with the next generation 
of solar telescopes. 
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1 Introduction 



Ground-based solar observations are currently entering a 
new era, mainl y thanks to two technological advances: (1) 
solar AO (see iRimmele I2OOOI) to surmount the deleteri- 
ous effects of Earth's turbulent atmosphere and (2) an open 
telescope des ign as demonstrated in the Dutch Open Tele- 
scope (DOT, iRutten et al.l 120041) . which was essential to 
overcome the aperture Umitation encountered in the tradi- 
tional design of solar vacuum teles copes. The New Solar 
Telescope (NST.I Oenker et a JI2OO6I) and the German GRE- 
GOR project ( Volkm er et al I l2007h with apertures of about 
1.5 m are currently being commissioned, thus, paving the 
way for the 4- meter class Advanc ed Technology Solar Tele- 
scope ( ATST, IWagneretalJl2008l entering the co nstruction 
phase ) and the European Solar Telescope (EST, CoUadosI 
20081 in the design and development phase). 



Imaging spectropolarimeters belong nowadays to the 
standard equipment of solar telescopes, since they are 
photon-efficient and the data can be improved using 
image restoration techniques without requiring multi- 
conjugate AO to observe a large field-of-view (FOV). 
This type of instrument has been in use for almost 
two decades, e.^., the Gottingen Fabry -Perot interferom- 
eter dBendlin. Volkmer. & Kneen 1 19921) and the Telecen- 



tric E talon Solar Spectrometer (TESOS, iKentischer et al 



19981) at the Vacuum Tower Telescope (VTT) on Tener- 
ife, the Interfer ometric Bidimensional Spectrometer (IBIS, 
Cavaninil l2006') at the Dunn Solar Telescope (DST) in New 
Mexico, and the visible-ligh t and NIR imaging magne- 
tographs (iDenker et al.l l2003h at Big Bear Solar Observa- 
tory (BBSO) in California. First results of the recently in- 
stalled CRISP imaging spectropolarimeter at the Swedish 



Solar Telescope (SS T) on La Palma were presented in 
Scharmer etal] ilOOj) . 

Finally, t he transition of the Got tingen Fabry-Perot in- 
terferometer ("Puschmann et al."2006) to the GFPI has been 
described in Puschmann et al. (2007). Early commissioning 
has already started at GREGOR using a 1 -meter aperture 
CeSiC mirror on loan from the SolarLite project. After in- 
stallation of the final 1 .5-meter Zerodur mirror commission- 
ing and science demonstration time will continue until the 
end of 201 1 before entering routine observations in 2012. 

Challenges for instrumentation and data analysis will be 
described in the following sections focussing on the GFPI. 
This selection, however, is just a reflection of the author's 
bias and familiarity with this instrument. Despite this, many 
conclusions should be applicable to other imaging spec- 
tropolarimeters as well as other types of instruments, which 
are envisioned for the next generation of solar telescopes. 

2 GREGOR Fabry-Perot Interferometer 

GFPI is a dual-etalon Fabry-Perot interferometer for high- 
resolution two-dimensional spectropolarimetry. The coat- 
ings of the etalons were optimized for the wavelength range 
from 530-860 nm. The spectral resolution is about TZ = 
250, 000, which makes it possible to use spectral line inver- 
sion codes to derive physical parameters from sequences of 
narrow-band filtergrams. The image scale is 0.038" pixel"^, 
which results in a FOV of 52.2" x 39.5" taking into account 
the 1376 X 1040 pixel detectors. The diffraction limit of the 
1.5-meter GREGOR telescope at 600 nmis X/D = 0.082", 
which corresponds to about 60 km on the solar surface. Im- 
age restoration will always be essential to increase the data 
quality, since AO correction is only valid for the isopla- 
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Fig. 1 Maps of physical parameters derived with imaging spectropolarimetry for a region containing small-scale mag- 
netic fields. 



natic patch (with a diameter of w 5") and even with multi- 
conjugate AO the correction is limited to FOVs with diam- 
eters of K, 30". Furthermore, high-order aberrations might 
not be completely corrected by AO and MCAO because of 
limited bandwidth and wave front reconstruction errors. Im- 
age restoration in combination with MCAO still has to be 
explored but no principle problems are to be expected. 

Narrow- and broad-band filtergrams are recorded simul- 
taneously at a rate of about 15 frames s~^ with 2x2 pixel 
binning and a 12-bit digitization depth. Each pair of images 
is then saved as a binary file using an on-the-fly compression 
algorithm. A typical data set consists of 4 x 8 x 25 — 800 im- 
ages, i.e., four polarization settings, eight ima ges per wave- 
length point for speckle polarimetry tKeller & von der Liihe 
19921) . and 25 wavelength points to cover the spectral line. 
This results in a data volume of 600 MB per line scan. To in- 
crease the data rate a RAID-0 controller distributes the data 
stream to four SATA harddisks. In this observing mode, the 
data rate is about 10 MB s^^. Assuming two hours of ob- 
servations per day results in about 75 GB of science data. 
Approximately the same amount of calibration data needs 
to be recorded. The overall data volume of 150 GB per day 
and a few terabytes per observing run is still within the lim- 
its, which can be handled by a principle investigator (PI). 
The data reduction, even though approaching the limits of 
office PCs, can still be carried out by the PI, if the results 
of the observing program are not immediately needed. An 
example of physical parameters derived with imaging spec- 
tropolarimetry is shown in Fig.[r| 

One guiding question for solar instrumentation is, if we 
make good use of all available photons. The resolution-lu- 
minosity product of Fabry-Perot-based systems is very good 
owing to the fact that (1) the transmission of the etalons is 
high and that (2) a large FOV is accessible, while only the 
wavelength domain needs to be scanned. The resolution- 
luminosity product is thus an order of magnitude higher 
compared to scanning spectrographs employing gratings. 
Consequently, only minor gains are to be expected optimiz- 
ing the optics of the instrument, AO system and telescope. 

One obvious way to improve the photon efficiency of the 
system is to improve the duty cycle of the detectors. While 



the current exposure times are of the order of 10-20 ms, 
the data acquisition rate is only 15 frames s^^. However, it 
could be as high as 50-100 frames s~^ considering the rel- 
atively short exposure times. Thus, the temporal resolution 
could be increased 3-6 times with high frame rate detectors. 

Before describing new detector technology in detail, let 
us briefly discuss the impact of higher frame rates for image 
restoration and imaging spectropolarimetry. Short exposure 
times (A^cxp < tq « 40 ms) are needed for post-facto im- 
age restoration to "freeze" the seeing in individual expo- 
sures. Here, to is the typical coherence time of daytime see- 
ing. Typical exposure times are in the range from 5-20 ms. 
Assuming Aiexp = 20 ms, which is a good choice consider- 
ing that the narrow-band filtergrams are photon-starved, we 
would arrive at a maximum data acquisition rate of 50 Hz. 
The other important time scale results from the photospheric 
sound speed Cg w 8 km s^^. The size of a pixel on the so- 
lar surface would be about 28 km, i.e., a feature moving at 
a velocity Cs would traverse that distance in about 3.5 s. In 
principle, only 3.5 x 50 = 175 images could be obtained 
during this relatively short time peri od. If four images are 



used for full Stokes polarimetr y (see iBalthasar et al.ll2009 



Bello Gonzalez & Kneed l2008h and 25 wavelength points 
are used to cover a line, about two complete scans could be 
carried out. However, using speckle polarimetry about eight 
images are needed per wavelength point, increasing the ob- 
serving time four times to about 15 s. In this case, features 
traveling faster than 2 km s~^ would violate Nyquisfs sam- 
pling theorem. The fact that two images are taken within 
To is of minor concern, since they are obtained in different 
polarization states and reconstructed independently. 

3 Impact of large-format detectors with high 
data acquisition rates 

Commercial, of-the-shelf (COTS), large-format detectors 
with high signal-to-noise (S/N) and high data acquisition 
rates are currently entering the market. At the moment the 
GFPI is using two Imager QE CCD cameras with Sony 
ICX285AL detectors. The cameras are part of a turn-key 
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system manufactured by LaVison dwww . 1 avis ion . d e*). 
which runs on the Da Vis imaging software. DaVis also han- 
dles the communication with peripheral devices such as the 
Fabry-Perot etalons, the liquid crystal retarders of the po- 
larimeter, movable mirrors, etc. COTS technology has the 
advantage to easily upgrade existing systems once new (de- 
tector) technology becomes available. 

Scientific CMOS (sCMOS, i www . scmos . coml l is one 
candidate for future upgrades of the GFPI, since it will be 
supported by La Vision's DaVis software. The format of the 
sCMOS sensors is 2560 x 2160 pixel with a pitch of 6.5 /im 
X 6.5 /im. A microlens array is used to improve the photon- 
collecting efficiency. The wavelength coverage and quan- 
tum efficiency (QEj^^j^jj — 60%) is comparable to that of 
the Imager QE system. In the global shutter mode using a 
split frame architecture, the maximum frame rate is 50 Hz, 
which is exactly as needed for imaging spectropolarimetry. 
Considering that the exposure time is 20 ms and that the 
charge transfer after an exposure is complete in less than a 
1 /xs, no image smear is expected using the electronic shut- 
ter, i.e., no mechanical shutters are needed. 

Anti -blooming ensures that, e.g., bright features such as 
flares will not affect neighboring pixels. The rms read noise 
of the sCMOS detector will be 2-3 electi'ons for the 50 Hz 
frame rate. Thus, a dynamic range of 84 dB (16,000:1) can 
be reached so that a digitization depth of 14-bit is required 
to record the signal without any loss. The intrinsic non- 
linearity of the sCMOS device is about 1 % but can be cor- 
rected to better than 0.2%. Dual analog-to-digital converters 
(ADCs) with high and low gain settings provide simulta- 
neously a high S/N and broad dynamic range. This is im- 
portant for solar observations considering the low contrast 
of solar granulation and the high dynamic range required 
to observe sunspots. Much of the information contents of a 
spectral line is contained close to the core, where the rest in- 
tensity is low. Here, the largest gain of the dual ADCs is to 
be expected. Finally, the sCMOS device offers standard fea- 
tures such as binning and region-of-interest (ROI) read-outs 
so that read-out speed and/or S/N can be improved. 

Carrying out the same computations as in Section|2] we 
arrive at a data volume of 8.8 GB for the 800 images in a 
spectral line scan. Note, however, that even though the data 
volume is 15 times larger, it only takes a third of the time 
to acquire the data. As a benefit, taking the calibration data 
will only take a third of time as well, thus reducing the ob- 
servational overhead by a factor of three. In summary, mak- 
ing the leap to the next generation of COTS detector tech- 
nology will increase the data volume by a factor of 50. In 
the following, we will discuss some of the implications and 
show that this requires a paradigm shift for ground-based 
solar instrumentation. 

If we assume again a two hours observing day and 
30 min worth of calibration data, the daily data volume will 
be about 5 TB even with lossless compression. These data 
rates and volumes can be handled by todays technology us- 
ing, e.g., dual Camera Link interfaces, RAID controllers and 



SATA-600 harddisks, dual 64-bit/lOO MHz PCI buses, and 
100 Gigabit Ethernet. These hardware devices belong to the 
high-end sector and require knowledgable technical support 
to build a working system. Obviously, the resources to deal 
with such data volume go well beyond what Pis of an ob- 
serving run will find at their disposal in their office. 

Similarly, we can arrive at an estimate of the computa- 
tional efforts required to analyze such data. Image restora- 
tion of a data cube of 800 subimages with 128 x 128 pixel 
takes about 40 s on a single CPU. Speckle deconvolution 
and data calibration of narrow-band images raise the com- 
putation time for the stack of 800 subimages to about 80 s. 
The size of the subimages corresponds approximately to the 
diameter of the isoplanatic patch (w 5" or 3600 km on the 
solar surface). Allowing for some overlap of neighboring 
isoplanatic patches, we arrive at 40 x 34 = 1360 isopla- 
natic patches, which need to be individually restored before 
being reassembled to yield the restored spectral line scan. 
The computation time for one spectral line scan would be 
about 30 hours. The total computation time for the 450 spec- 
tral line scans during the two hour observing period would 
be about 600 days on a single CPU. Thus, data analysis 
presents an even more stringent challenge than handling the 
data volume. However, using a cluster with 500 quad core 
CPUs would reduce the computation time to less than one 
day as needed to keep up with the stream of observational 
data. On a positive note, once the data is reduced, the vol- 
ume is reduced by a factor of 10 to about 500 GB per day. 
While still not small, this data volume can be handled in the 
archives of today's virtual observatories. 

4 Discussion 

While the previous sections were concerned with the par- 
ticulars of the GFPI and possible upgrades to large-format, 
high frame rate and high S/N detectors, the discussion will 
focus on the broader picture. Imaging spectropolarimeters 
are photon-efficient instruments and with the advent of new 
detector technology, the last remaining inefficiency can be 
removed. Thus, each precious photon can be detected. Fur- 
ther gains in photon-efficiency would require multi-instru- 
ment, multi-wavelength observations. This has been imple- 
mented in the GREGOR concept for post-focus instruments. 
Dichroic beamsplitters (pentaprisms) are used for simulta- 
neous observations with the GFPI, the scanning near in- 
frared spectrograph and broad-band imagers. 

The Blue Imaging Solar Spectropolarimeter (BLISS) is 
a 2"*^ generation instrument for GREGOR, which will add 
observing capabilities in the blue part of the spectrum (be- 
low 530 nm) in 20130. This is also cost-effective consid- 
ering that the cost of building a telescope scales with the 
area of the primary mirror. In terms of spatial resolution, ob- 
serving at 400 nm instead of 600 nm corresponds to using 
2.25-meter instead of a 1.5-meter telescope! On the down- 
side, multi-instrument observations raise the complexity of 
instruments, data calibration/analysis, and operations. Even 
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today data calibration will take as much (or even more) time 
than science observations. Therefore, a major effort has to 
be spent on the development of a reliable and well docu- 
mented production code for data calibration and analysis. 

Exponential growth rates are encountered in a variety 
of areas relevant to imaging spectropolarimetry: processing 
speed, harddisk and memory capacity, network bandwidth 
(which is today's bottleneck), number of pixel in digital 
cameras, but also in the power consumption of computer 
nodes. The growth rates are related to what is nowadays 
called Moore's law, i.e., the statement that the number of 
transistors that can be placed at minimum cost on an inte- 
grat ed circuit has doubled approximately every 18 months 
(see lMoorelll965h . The results of the digital revolution have 
been of enormous benefit for astronomical instrumentation. 

However, the quest for photon-efficiency has driven the 
instruments to a level of complexity, where the data han- 
dling, storage and analysis requires high-end computer tech- 
nology, i.e., data rates of modern solar instruments reach the 
limits of today's technology. Since the next generation of 
solar telescopes (ATST and EST) will use even larger detec- 
tors, Moore's law only ensures that the requisite technology 
will be available. However, we should not expect that the 
demand for computer resources will diminish, i.e., photon- 
efficient instruments will be in step with innovation cycles. 
Current predictions project the validity of Moore's law to 
hold until 2020, when ATST and EST would be operational. 

Annother word of caution might be appropriate at this 
stage, Moore's law does not apply to institute budgets or 
funding schemes! Since data rates and volume exceed the 
resources of individual users, the data has to be analyzed in 
data centers, which could be located at the host institutions 
of the post-focus instruments. This in turn means that signif- 
icant resources have to be reallocated or new funding has to 
be acquired. For new instruments the total cost of ownership 
(TCO) has to be considered, which consists of (1) the cost of 
acquisition and (2) the cost of operation, which can be full 
of hidden costs, e.g., the personnel and computer resources 
at the data center. While COTS parts might help to reduce 
the cost of an instrument, it has a minor impact on the cost 
of operations. The GFPI might be the last of a type of solar 
instruments, where TCO could be safely ignored. The oper- 
ating costs of the next generation of instruments might be a 
significant part of the budget of a national facility. 

Imaging spectropolarimeters offer much built-in flexi- 
bility, e.g., binning, line selection, polarimetric observing 
modes, number of wavelength steps, spectral sampling, etc. 
But does this meet the needs of an average user? In many 
cases, the scientific objectives are relatively simple. Usu- 
ally, the basic physical parameters of a solar feature need 
to be measured. Restricting oneself to some basic settings 
has the advantage that data base searches for certain solar 
phenomena would lead to data sets with similar characteris- 
tics. If data sets become too disjointed, the usability of the 
spectropolarimetric data will suffer Considering the signifi- 
cant investments in new instruments, a major fraction of ob- 



serving time should be reserved for synoptic observations, 
whereas Pl-driven observing campaigns with dedicated set- 
ups should be limited to observations, which promise a high 
scientific impact. The discussion of how the complex post- 
focus instruments of the new generation of solar telescopes 
can serve a broad community has just begun. 

This article is intended as a contribution towards the pri- 
oritization of science, which can be addressed with imaging 
spectropolarimeters. Efficiency, reliability, and availability 
are here the key issues for the respective data analysis and 
archiving. The GFPI offers a unique opportunity to explore 
new observing paradigms and provides guidance for the 
next generation of solar telescopes and instruments. 
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